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Abstract 

Recently suggested method of measuring Renyi entropies of multi- 
particle systems produced in high-energy collisions is presented in the 
form of a "do-list", explaining explicitely how to perform the mea- 
surement and suggesting improvements in the treatment of the data. 
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1 Introduction 

A possibility to estimate the Renyi entropies P of the multiparticle systems 
created in high-energy collisions was suggested some time ago by two of us 
[2]. The method is based on observation of the event-by-event fluctuations 
or, more precisely, on measurement of coincidences between different events 
observed in collisions. Being classical in nature, the analysis of could 
not, however, provide the absolute scale for entropy and thus the obtained 
numbers suffered from a serious uncertainty. Recently, we published several 
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papers discussing a quantum approach to the same problem [3-5]. This al- 
lows to reduce the uncertainties of the classical treatment and to formulate 
the improvements of the method, leading to a more precise determination 
of Renyi entropies from data. Since the Renyi entropy gives the lower limit 
on the Shannon entropy €j, such measurements may provide essential infor- 
mation^ on the structure of the system produced in high-energy collisions 

In the present paper we collect the results of [3-5] in the form of a "do 
list", i.e. of an explicit prescription how to perform the measurements and 
how to estimate the necessary corrections. We spell out explicitly the steps 
to be taken to implement effectively the results of [3-5]. The importance of 
the dependence of measurements on discretization of particle momenta and 
the role of (multi)particle correlations are emphasized. The paper may be 
considered as an extension of the previous publication with a similar title [H] , 
but it can be read independently. 

2 Selection of the phase-space region 

As the first step in the process of measurement one has to select a phase-space 
region in which measurements are to be performed. This of course depends on 
the detector acceptance as well as on the physics one wants to investigate. 
The region cannot be too large because for large systems the method is 
difficult to apply (the requirements on statistics become too demanding). 
With a statistics of 10^ events, the region containing (on the average) ~ 100 
or less particles should be possible to investigate. A reasonable procedure 
seems to be to start from a small region and then increase it until the errors 
become unacceptable. 

Comment: The proposed measurement is not restricted to systems with 
large number of particles. It can be applied to any multiparticle system, 
e.g., to e^e~ annihilation, hadron-hadron collisions or peripheral nucleus- 
nucleus collisions. It was tested for the PYTHIA MC code for pp collisions 
[TU] and recently employed for data on hadron-hadron collisions by the NA22 
collaboration [TTj . 

^For a recent discussion of this point, see (Jj- 
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3 Discretization of the spectrum 



The selected region in momentum space^ should now be divided into bins. 
The size of the bins is — in principle — arbitrary. It turns out to be conve- 
nient to express it in the form 



AK.AKyAK, 
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3/2 

(1) 
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(positive) parameters, and Ll,Ly, are the mean square radii of the system 



where / is the rank of Renyi entropy to be measured, arbitrary 
(positive) parameters, and 
in configuration space, e.g 

Ll = J{X - XyD{X,Y,Z)dXdYdZ . (2) 

Here D{X, Y, Z) is the normalized distribution of positions of particle emis- 
sion points in configuration space. 

As seen from the parameter gulator of the size 

of the bins used for discretization of the spectrum. Note that n need not 
be constant through the selected momentum space. Actually it may be — 
generally — convenient to vary k, with the position of the bin in momentum 
space. For example, in case of boost invariant distribution it is reasonable 
to discretize with bins of equal size in rapidity. The well-known equality 
dKz = E{K)dy suggests to take 

K, = E{K,,K^)nf , (3) 

where E{Kz, Kj_) is the particle energy in the considered bin [K^ and K± 
are the central values in this bin), while k^^^ is a constant. 

Although the value of the measured Renyi entropy does not depend on 
the choice of k, it should be emphasized that its selection does influence the 
accuracy of the measurement. 

The number of bins cannot be too large if one wants to keep the statis- 
tical errors under control. It follows that (jT]) restricts the acceptable values 
of K and of the size of the momentum phase-space region which one may 
reasonably investigate at a given statistics of the experiment. 

^We use the notation K for momenta and P, W for probabilities. 
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4 Description of an event 



Using this procedure, an event is characterized by the number of particles 
in each bin, i.e. by a set of integer numbers s = m^^\ where j = 1, ...J (J 
is the total number of bins) and the superscript (z) runs over all the kinds 
of particles present in the final state. These sets represent different states of 
the multiparticle system which were realized in the given experiment. The 
number of possible different sets is, generally, very large (for 5 bins and 100 
indistinguishable particles one obtains about 5 x 10^ sets). This is, in fact, 
the main difficulty in the application of the method. It reflects the fact that 
the system we are dealing with has very many possible states. 

Comment: It should be realized that, in practice, such a description is 
never complete, i.e., it never describes fully the event (even if the bin width is 
ignored). Most often some of the variables are summed over. This is the case, 
e.g., when one measures only charged particles. Then all the variables (i.e. 
multiplicities and momenta) related to neutral particles are summed over. 
It may be thus interesting to study reduced events, when even some of the 
measured variables (e.g. particle identity) are summed over (i.e. ignored). 

5 Measurement of experimental coincidence 
probabilities 

As explained in |2j, the measurement of experimental coincidence probabili- 
ties is the basis of the method and therefore the most important step in the 
whole procedure^. 

The measurement consists of the simple counting how many times (n^) 
any given set s appears in the whole sample of events. Once the numbers 
are known for all sets, one forms the sums: 

N{l)=J2Mns-l)...{ns~l + l) (4) 

s 

with / = 1,2,3, ... . Each sum formally runs over all the sets s recorded in 
a given experiment, but nonvanishing contributions are given only by those 

•^The method was adapted to the present context from the original proposal by Ma 

m 
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which were recorded at least / times'^. Thus N{1) is the total number of 
observed coincidences of / configurations and it can be recognized as the 
factorial moments [2] of the distribution of Us (in particular, N{1) = N, 
where is the total number of the events in the sample). The coincidence 
probability of I configurations is thus given by 

N{N -1)...{N -l + l) ^ ■ ^ ^ 

Of course C^^^^l) = 1. As explained in j2], this ratio is equal^ to the 
(/ — l)-th moment of the probability distribution: C^^^i^l) = J^siPsY- 

It is clear that two identical configurations must have the same total 
number of particles measured in the phase-space region considered, say M. 
It turns out that to obtain Renyi entropies, it is necessary to determine 
(jexp^j^^ for each multiplicity separately. We shall denote these numbers by 

The error of C"^^p(Z) is determined by the error of the numerator in (jSJ. 
One finds approximately [AN{1)]'^ f» l\N{l). 

6 Renyi entropies 

To obtain the Renyi entropies: 

H{1) = ^^log C{1) (6) 

it is necessary to determine the true coincidence probabilities: 

C{1) = Tr[pf (7) 

with p being the density matrix of the system. C{1) can be expressed in 
terms of the true coincidence probabilities CMil) at fixed multiplicity: 

C{1) = Y.[P{M)YCm{1), (8) 

M 



^Since the number of different sets is very large, most of them shall appear only once 
or not at all. 

^The proof follows closely the argument of |14| . 
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where P{M) is the multiphcity distribution^. 

The relation between Cm{1) and the measured C^^^(/) was studied in 
[3-5]. It can be summarized as follows: 

CM{l)=Ctni)^M{mM{l). (9) 

The correction factors Am and (P'm depend on M (this is the reason why 
C'^m'^}) Hiust be determined for every multiplicity separately). They are 
discussed in the next two sections. 



7 Estimate of Am[1) 

Denoting the (3M dimensional) normalized momentum distribution by 

w{K) = e~"(^), (10) 
and the size of a bin j by uoj the correction factor Am{1) is given by 



^m(0= ^ luiu-r. i/ ' (11) 



where the summation extends over all (3M-dimensional) bins and de- 
notes the average over a bin of volume {ujj)^'\ e.g., 



UJj J 

We have also introduced the shorthand 

w^{K) = - / d^'^'KwiK) = {w{K))^. (13) 

00 J 

To estimate Am{1) we observe that summations in numerator and denom- 
inator of ()11|) can be expressed as integrals over the considered phase-space 
region. We thus have 



^We remind the reader that M is the number of particles taken into account in the 
measurement. It need not be identical with the number of all particles measured in the 
part of momentum space considered in the analysis. 
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If K is independent of the bin (i.e. independent of K), this formula sim- 
phfies into 

Am{1) = ^ Mm(/), = J^5m^J-(^ • (15) 

One sees that in this case ^1^/(0 tends to one if the size of the bins is 
small enough (i.e. when w{K) can be treated as constant within one bin). 
Then the value of Am{1) is under full control. 

If the bins are not small enough, one sees from (fT^ and (fT^ that Am{1) 
can be estimated using the MC code appropriate for the given process. For 
the numerator this is rather straightforward. For the denominator, it is 
necessary to construct first the "smeared" MC which ignores the difference 
between the momenta of particles within each bin. 

A simpler, but less precise, method is to ignore correlations between par- 
ticles and write the distribution w{K) in form of the product 

w{K) = fiK,)...f{KM), (16) 

where f{K) is the single-particle momentum distribution. 
In this case we obtain 

am{i) = mr (17) 

with 

and thus A(/) can be fairly easily evaluated numerically or even analytically. 



8 Estimate of ^m{1) 

The second correcting factor is given by the formula ^ 

_ JJ"A-|u,(A-)|'e,(/0 ,19) 
''"•yi Sd'"-'K\w(K)]' • ' ' 

where 



[ei{K)]-^ = Det 



s=l 



(20) 
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and 



1 (^-1)! 
''^^^^^ 2^ (2s + !)!(/ -2s- 1)!' ^^^^ 



T is the symmetric 3M x 3M matrix 



1 1 



with 



Here m, n = 1, ...,M label the particles and a, P = x,y, z denote the space 
directions. 

It is seen from these formulae that ^m{1) is independent of the bin size 
and thus cannot be influenced by selection of n. It does depend, however, 
on the size of the system in configuration space [L^, Ly, L^). Moreover, as 
explained in Eq. (jl9p represents an expansion in powers of and thus 
can only be trusted if L is large enough, so that ^m{1) is not too different 
from one''. 

Note that ()21|) implies that the sum in ()20|) is finite, because all cis(/) 
vanish for s > (/ — l)/2. In particular for / = 2 we obtain 02 = 1 and thus 
also !^m(2) = 1. For the other two practically interesting cases (/ = 3,4), the 
sum reduces to just one term with 

«i(3) = ^, «i(4) = ^. (24) 

Again, a MC code seems to be the best method to estimate !^m(0- Indeed, 
Eq. (fT^ can be rewritten as 

^m{1) = I d^'KPi{K)e{K) = (O), (25) 

where the probability distribution Pi{K) is defined as 

PdK) - t"^^)]' (26) 



^It is clear that 'Pm{1) approaches one in the hmit of large L's. 
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To construct 0{K), however, an analytic formula for w{K) is necessary, as 
seen from (I22|) and (j23p . This may be a difficulty. 

If correlations between particles are neglected, the matrix Tma^np is di- 
agonal in (m, n) and the calculation of the determinant in ()2U|) is greatly 
simplified. We write 



M 



m=l 



and thus 



We shall only consider / = 3 (!P'm(2) = 1). We have 



[Oi{K)]-' = Det 



1 + — 

12^ J 



M 



n D{K„ 



(27) 



(28) 



(29) 



m=l 



where D{Km) is the determinant of the 3x3 matrix 

1 dmadml3u{Km) 



D{K„ 



Det 



1 + 



12 



LrvL 



(30) 



Further simplifications are possible if the system is cylindrically symmetric, 
i.e., if u{K) = u{k±, fcy). Then 



D{K) = AA^ + A{klB + C) + kl{BC - 



(31) 



where 



A 
C 



1 + 



1 du 



12L\ k± dk^ ' 



B 



1 



12L±L\\k± dkiidkj 
and the correction is given by 



ULlkl 
1 d\ 



d'^u 1 du 



dk^ k± dk± 
1 1 du 



1211 dkf, 12L^ k\dk\ 



(32) 



>Z^m(3) 



/ \e-^<^yD{K)\ dkldk 



J e-^<^)dkldk\\ 



M 



(33) 
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9 Remarks on size of the region in momen- 
tum space 

The main difficulty in the measurements is to find a sufficient number of coin- 
cidences (to keep the statistical error under control). Therefore it is necessary 
to limit the size of the region in momentum space where the measurement 
is performed. This reduces the number of particles and thus increases the 
probability of coincidence. Below we estimate the practical consequences of 
this requirement. 



9.1 Consequences of boost-invariance 

Consider first the longitudinal momentum. If the system is approximately 
boost-invariant, one expects an approximate linear relation between the con- 
sidered interval in longitudinal momentum [SK^) and the size of the corre- 
sponding region in the configuration space (L^, defined as the region from 
which the emitted particles end up in 6Kz): 

i.-^. (34) 
where the proportionality coefficient can be approximated by J3] 

h^ = ^ (35) 

To 

while m± is the transverse mass of the produced particle and tq is its proper 
time at freeze-out. 

The conclusion is that the size of the selected region in longitudinal mo- 
mentum determines the size of the corresponding region in configuration 
space. Consequently, the size of the selected region in longitudinal momen- 
tum cannot be too small (if we want the size in z-direction to be large 
enough for the analysis of this paper to be valid). Note that these remarks 
do not refer to the choice of the binning (discretization) but to the size of 
the momentum region in which the measurement is performed^. 



^By an appropriate selection of Kz, bins can be fixed at will. See the discussion in 
Section 3. 
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9.2 Uncorrelated distribution in azimuthal angle 

Great improvement in the feasibility of measurement can be obtained if corre- 
lations between particles are weak and can be neglected. This is particularly 
effective if there are no correlations between various segments of the distribu- 
tion in azimuthal angle. In this case the probability to observe a coincidence 
in the full azimuthal angle (27r) equals the square of the probability to ob- 
serve a coincidence in half of the full angle (tt). Therefore it is enough to 
observe the coincidences separately in two regions of size tt where the co- 
incidence probability is much larger. Consequently, one needs much fewer 
events to obtain a decent statistics of coincidences (and thus a decent error 
of the measurement). The effect can be made even stronger if independence 
is observed for smaller regions of azimuthal angle. The procedure requires, 
of course, a careful checking with the data. 



10 Numerical estimates 



To obtain an idea about the size of corrections Am{1) and l^Af (/) we shall now 
explicitely evaluate them in a simplified model where particles arc uncorre- 
lated and the single particle momentum distribution is axially symmetric 
and boost- invariant. The transverse momentum distribution is taken in the 
Boltzmann form. Thus we have 



kl 



h.2 



d k±dkz , 



(36) 



where A is a normalization constant chosen such that Jw{k±, kz)d/^k±dkz — l- 
Consider first Am{1) = [X{1)]^ with 



A(0 



Ebins / d'k^e-^-^-/^ J 



LOj_ 



Skz 



dkz 



[u!±Skz 



^bins 



a;x 5kz \/^z+m]_ 



(37) 



where 



5k z 



TrSk', 



2tt 



(38) 
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In figure 1 the correction factor 



52 



H{2) 



H{2) 



cxp 



(39) 



is plotted as function of L^/k,±_ (with k± independent of K) for = 1 fm, 
= 1 and two values of T. The longitudinal momentum interval was fixed 
by —0.38 GeV < < 0.38 GeV. One sees that for Lj_/k,j_ greater than 1 fm 
the correction is small. 
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Figure 1: The correction factor 1 — H (2) / H^^^ (2) plotted versus L±/k± with 
a constant k,± and = 1. Other parameters are indicated in the figure. One 
sees that for L^/k,± > 1 fm the correction is pretty small. 

It should be emphasized that, as discussed already in Section 7, the cor- 
rection factor to H2 can be fully controlled with a good precision if the bins 
selected for discretization are small enough. If the size L± of the system 
is small, this can be achieved by a proper choice of the parameter k. The 
results shown in figure 1 demonstrate that to this end it is enough to take 
L±/k± larger than 1 fm. Since the measurement of H2 provides an effective 
lower limit on the value of the entropy of the system [7] , it is reassuring that 
in this simple way the errors can be minimized and reliably estimated. 

For Z > 3 both 71^(0 = [A(/)]*^ and !Z^m(0 = are important. This 

creates a new problem. Indeed, since the correction factor is insensitive 

to the bin size, it cannot be eliminated by a proper discretization {^m{1) does 
not depend on k and thus cannot be adjusted at will). 

In figure 2 the correction factor 



5s 



H{3) 



exp 



(40) 
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Figure 2: The correction factor 1 — iJ(3)/if°^P(3) plotted versus L± with 

K± = Kz = 1. 

is plotted versus L± for = = 1 and for the same parameters as in 
figure 1. It is seen that the corrections are reasonably small for L± > 1 fm 
but become dangerously large for smaller radii. Thus for I > 3 the method 
seems safe for heavy ion collisions but cannot be easily justified for systems 
with linear size smaller than 1 fm. 

11 Shannon entropy 

The Shannon entropy S (i.e. the standard statistical entropy) is formally 
equal to the limit of H{1) as 1^1 and thus can only be obtained by extrap- 
olation from a series of measured values: H{1) = H{2), H{3), ... to I = 1^. 
Of course such an extrapolation procedure is not unique and introduces a 
serious uncertainty [15]. The main point is, as usual, to choose the "best" 
extrapolation formula, i.e. the functional dependence of H{1) on / which will 
be used to reach the point / = 1 from the measured points / = 2, 3, ... . This 
form can only be guessed on the basis of physics arguments (or prejudices). 
In j2j it was suggested to use 

H{1) = + ao + a,{l - 1) + a^il -!)' + ..., (41) 

^Obviously, one cannot just put ^ = 1 in the formula © for that purpose: since 
C(l) = 1, the r.h.s. of JHl for Z = 1 represents the undefined symbol 0/0. 
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where the number of terms is determined by the number of measured Renyi 
entropies. This formula turned out to be very effective in reproducing the 
correct value of entropy for some typical distributions encountered in high- 
energy collisions. 

Another possibility is to use 

H{1) = ao + ^ + ^ + ... (42) 

suggested by the formula for the free gas of massless bosons^'^. 

It will be interesting to compare the results from these two formulae. 

Comment: The measured values of the Renyi entropies give valuable 
information about the system and thus are of great interest, independently 
of the accuracy of the extrapolation ^Jj. Moreover, from the inequality [0] 

S > H{1) > H{1 + 1) , (43) 

valid for any / > 1, we deduce that a measurement of any Renyi entropy 
gives an exact lower bound for S. It is well known that this is important 
information about the quark-gluon plasma jHj. 

12 Comparison of different regions: Additiv- 
ity 

Measurements of the entropies H{1) and S", as described above, can be per- 
formed independently (and — in fact — simultaneously) in different mo- 
mentum regions. The results should give information on the entropy density 
and its possible dependence on the region in momentum space (e.g., it seems 
likely that the results in the central rapidity region may be rather different 
from those in the projectile or target fragmentation region). Furthermore, 
it is important to verify to what extent the obtained entropies are additive, 
i.e., whether the entropies measured in a region R which is the sum of two 
regions Ri and R2 satisfy 

H{l){R) = H{l){R,) + H{l){R2) ^ S{R) = S{R,) + S{R2) . (44) 

-"^^For the free gas of massless bosons the Renyi entropies are given by H{1) = {1 + 1/1 + 
1/P + l/l'^)S/A where S is the Shannon entropy (2]. 
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Eq. (j44|) should be satisfied if tliere are no strong correlations between the 
particles belonging to the regions Ri and R2- Thus, verification of (jHI) gives 
information about the correlations between different phase-space regions. 

Comment: It may be worth pointing out that the additivity ()44|) can be 
more precisely tested for Renyi entropies {H{1)) than for the Shannon en- 
tropy (5), where the extrapolation procedure (described in Section 6) always 
introduces an additional uncertainty. Since deviations from additivity signal 
correlations, this is an interesting problem in itself. 

13 Conclusions 

In conclusion, we have shown that the measurement of Renyi entropies in 
limited regions of phase-space is feasible and thus important information on 
the entropy of the system [SI [7j is possible to obtain. Moreover, even the 
simplest tests of the general scaling and additivity rules can provide essential 
information on fluctuations and on correlations in the system. It should be 
emphasized that for these tests the Renyi entropies turn out to be even more 
useful than the standard Shannon entropy. 

We thank K. Fialkowski and W. Kittel for discussions. This investigation 
was partly supported by the MEiN research grant 1 P03B 045 29 (2005-2008). 

Appendix: 

Various examples of probability distributions 

Distributions with exponential tail 

Consider the distribution 



where 6ri is small, so that we can replace everywhere the summations by 
integrals. We also assume that Svi = const = 6. With this assumption the 
normalization factor U is given by 



6ri 



1 1 



(45) 




a + l 



(46) 
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The distribution (|45|) covers a wide range of different distributions. E.g., for 
{a = 0, (3 = 2) one obtains a Gaussian, for (3 = 1 (and arbitrary a), a Gamma 
distribution (including, as a special case the exponential distribution). 
A fairly straightforward calculation gives 



H{1) = log 
and thus 



a r[{a + l)/(3] 
5 



lla + 1 



l-l 



log 



ma + l)/P] 
r[{a + 



S = lo£ 



ar[{a + l)/P] 
P5 



In particular, for a Gaussian we have^^ 

a^/7l 



Hg{1) = log 



6 



+ 



2(/-l) 



(47) 



(48) 



(49) 



Power law 



dr 



P{r)dr = Xa^- ^ 

(a + r\ 

oo 



C(/) = A'a'V 



l+A 

dr 







(a+r)'(i+^) (/A + /-l)a'^+'-i 



A' 



/A + / - 1 



(50) 
(51) 



H{1) 
S 



\og{a/5) + 
log(a/5) + 



1 



/ - 1 
l + A 



A 



log (^1 + (/ - 1 
logA . 



1 + A^ 



log A, 



(52) 
(53) 



Sum of Gaussians 



Consider probabihty distribution which is a sum of two identical Gaussians 
separated by distance 2R. This can be written as 



Pir) 



1 



ax m 



(54) 



^^In this case we take — oo < r < +oo. The general formulae H45|l - H47|l are valid for 
< r < +00. 
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where A+ + A_ = 1, and gives 



= V _l-_AiA'r^e-^^'^-('-^)/('"') . (55) 

One sees that in the hmit of R/a very large, i.e. for well-separated Gaussians, 
only the terms with j — Q and j — I contribute and we have 

C(0=Cg(0(a'_ + A'+) , (56) 

which simply adds a constant term to the entropy of a single Gaussian. 
If A_ = A+ = 1/2, we have AL + A'+ = (1/2)'^^ and thus 

H{l)^HG{l)+\og2. (57) 

It is not difficult to see that for N well-separated Gaussians one obtains 



H{l)^HG{l)-j^^\og (em') 



(58) 



If all Gaussians have equal weights I — 1/N, one obtains 

H{l) = HG{l)+\ogN (59) 
This result is valid for any set of well-separated distributions. 
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